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'i’bT s study ori^inatsd in rssoonss to an incrsassing ccisifisntary on 
the process of evaluating instruction in the public schools. Although 
the experimental design *as constructed for use at the iunior college 
level, significant results say suggest aporopriate modifications for 
evaluating secondary teaching. 

Pr oblem 

fTir-. v.a o-r-Par-fi of text a2id lecture methods of 

instruction on student achievement during ten aays oi an introductory 

ff 

psychology course. 



Statement of Design 



The experiment employs a 



tvjo-v.ay, fully- crossed, factorial 

ft 

design vvith two levels of each classification variaole, plus a separate 
■pAs T*0 vsnc e ?rouo for de ts30'r..xni.ng efzect of pre~ i/Sst on po:>t“test. xhe 
subjects receive identical pre- and" post- tests developed to examine 
achievem-erit of cognitive behaviors. The reference group is split 
randomly, with one-half of the subjects receiving both pre-test and 
post-test and the remainder receiving. post- test only. 

Olassif lC3.tion variables are 1 ) use of text and 2 ) par oicipation 
in lecture sessions. Each variable occurs at two levels,, i.e., presence 

or absence. 

•VQ9 operational definition of the dependent variaole ^ student 
achievemen t) is the post-test. 

Table 1 depicts the analysis of variance design employed in the 



experiment 
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GroiJip I 
Group II 
Group ‘III 
Grou'o IV ■ 



Tab?.e 1 

AT13. 1 'v S 1 of* Y'l V 1 S.jl 1 C 9 Ds S 1 
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Procedures 

■T % ^ 

Characterist ics of subjects > - Subjects’ in the experimental group 

vjere enrolled in an introductory psychology course uith SCAT college 

> 

entrance scores ranging from the 15th to the 35th percentile. The 
inedian age for the 22 females and 26 males was ti'?enty-f our years; s. 
rather mature group considering that four subjects uere high school 
honor students. It is significant to consider that 801^ of the subjects 
were of ITagro ancestry, 5'^ of Chinese descent and 15^ of Caucasian 



ori??:in. 



The reference group consisted of students enrolled in an intro- 
ductory social science course (X=A3).‘ median age for the 23 females 

and 20 males uas tvjenty-one years ■^/7ith their SCAT college entrance 



scores ranging from the 


15 th 


to the 35th percen 


tile. It 


is again 


important to note that 


90% of 


the subjects were 


O 

0) 

O 


ancestry, 3% 


of Chinese descent and 


7 b of 


Caucasian origin. 


> 





S elec ti on o f subieets. - Registration cards for the experimental 
sroup vrere shuffled lace down by an outside observer and placed in four 
piles. The experimenter then assigned the sub'ects to the treatment 
:RJC grouns as fellows; 
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Group 


j 


Text -ar-d Lectv.i-e (1=12) 




Group 


T T 


J: a c i u r e Only ( 1; -- 1 2 ) 




Group 


III 


Text Only (::=12) 




Group 


IV 


neither Text nor Lecture 


(X:^12) 


h e i' e ^ e r e ■■■ c e ^ 

!• 

1 


roup 


xis randomly divided into 


A 

the f ollov.'ing : 


f 

Group 


Va 


?re-tsst and Post-test (K 


=24) 


Group 


Vb 


Post-test Only (1=24) 




Pre carat lor and 


Selec 


;tion of klaterials. - All 


treatment group 


sub.jects vere provid 


ed xii 


in a course outline and a 


copy of Bloom’s 



TaxoriO'iy of. Ed vo at l oiaa l O'o." e ct ives - modified for an axader:*? c . course 
in introductory psychology (Ses Appendix A). Hilgard and Atkinson’s 
text Int rodu c tion to Psycholo?^" - nas assigned to groups I and III v;ith 
instructions regarding its use during the experimental period. 

The test v/as concerned v/ith tv/o general categories of ability. 

The first reouirement vas the recall of factual data consisting of 
selected concents in personalii-v nsycholop'v. The second area reouired 
the application of anal.ytical skills and the use of inductive and 
deductive reasoning. (See Appendix C) The pre- and post- test consisted 
of fifty-five questions arranged in three sections of inultiole-choice , 
true-false and open-end essay tvoe. A total score of 100 points vras 
possible, viith the last section of ocen-end essay questions given 
greater e ig h t . 

Experim enta l treatm ents . - Group I (text and lecture) received all 



materials 


relevant to ' the co 


che ten days of instruction. 


textbooks 


for the course and 


regarding 


as signed -reading o 



n 

O* 



roovp II (lecture only) turned in their 



text. 



O A ,J| JL JL O ^ •«. MM. r. 



(Aev York: uavid Xcnay 



' ^ ^ r 



ra;.;oKon!v' oS 3ducat^ona.l Ob.isctivos 

ri56). ■ , 
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2. rimes t Hilgard and Richard Atkinson, Introduction to P svchol o 
o ;th Edition. (liev: York: Ha.rcourt Irace i- V.'orld Inc. *196?). 
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tb? 



T 



U ^ .'J t 



oocor^^'cic ir^taoo . 



T.h': £ 



The lecture v/3.s dasl.^ned to en-oh:-,size 
or- a'rii £0 ti on of oresen tntion allovi- the ntudent extensive autonox-j in 
deveiopir.x their analysis of peycholoy leal principles. The ir.ethod. 
an-phasizes student expertise rather than the customary autocratic 

instructors. Treatment of froup II during 



position 01 ina n y 



“t* *r| .o T P 1 T*P 
O 



sessions did. not differ from that of Group I v.’ith the exception that 



they turned in their textboo’\S durir.y the experimental period. Group lil 
(text only) received instructions for use o.f text and v^ere released 
from class attenda.noe dui'ln?* the experlTrental period. Group iv (neitner 
text nor lecture) received instructions for independent study, turned 
in their textbooks and did not attend class duriny the experimental 



n 



eriod . 



0 0 1 1 e c t i 0 n o :£ (Is. t g. . - All treatment groups uere yiven v.ne pre-L.esu 
and post-test. Group Va vas yiven the pre-test. Subsequent to the 
treatment period, Groups V.a and Vb both received the post-test. Tne 

sts nere mraded by an outside observer and the total 
noints for correct ansv.-ers vr.as miven as the rax score for 



or 



v' Vi .'■* C3 — 






•numocr oi 



each case. The rav: scores uere punched into data cards for compute^ 



orocessin?: . 



An al .y_ 3 i s an d R e sui ts . 

The analytical procedures employed included a t test, an analysis 
of variance and ? tests. 

Re ference mroup. Table 2 presents means and standard deviations 
of cost- test vseores for mroups Va and Vb. 
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— 4 p 'P. •'* > 4” VI '1 v' •‘*1 *n mr*l o ** n ? 

n. ■^•01*’^“* ^ * o r? V' ^ “ Vn 

'kXj. vJ U iJ o V c>. C---V. J 



01 



Group Va ( Pro- tost) 
roup Vb (i\0 Pre-test) 



r< 

’•jr 



-'1 93/:! 



18.83 

14,83 



^ T) 

kj 0 U • 



4.63 

5.61 



P 



24 

24 



A or.e-tail t test (alpba level of .01) vas used to determine tlie 
significance of th.e difference betvecen the post-test Deans of those 
receivin.~ the pre-test and those not receiving the pre-test. The 
critical value of t for 46 degrees of freedom is 2.40. The t 
calculated from the test scores is 2.63. The null hypothesis vras 
therefore re.i^cted in favor of the alternate hypothesis that subjects 
receiving the pfa-test did signif icantl.y better than subjects not 
receiving the pre-test. 

E xuerip ental aroup. - Post- test means and standard deviations 
for the treatment groups are given in Table 5« 

Table 3 

Post- test igeans and Standard I'eviatlons of 

Treatment Grouns 











Kean 


^ n 


11 


Group 


I ( 


Te 


xt and. Lecture) 


72.83 


*7 r-f — 7 

*xO . / / 
• 1 1 


12 


Group 


II ( 


Le 


cture Onlv) 


63 . 50 


43.13 


• 12 


Group 


III( 


Te 


xt Only) 


37 . OS 


38.76 


12 


Group 


IV ( 


1 . 3 


ither Text nor Lecture) 


39 . 16 


31.40 


12 



A.: 



er|c 
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U V< 



.- T 



•iicO. 


V< 1 

U . . JL 4 i . 


the 


post 


pha 


'I OVC.1 


\:as 


set 




for 1 


and 


44 d 



scores as fne dependent i^arlrble, ! 
which established a critical ? rati< 
of freedom. Only the main effect of the lectnre variable is sigr.l 
f leant. Table 4 siimrarizes the results. 

Table 4 . ’ 

Suramar.y of the inalysis of Variance 
ch Student Achievement 



Source 


SS 


dfb. 




F 


Text 


157.69 


1 




157.69 


1 . 23 


Lecture 


0 

0 

• 

0 

I\) 


1 


10330.02 


■S.77-; 


.1 Jv u jJ 


ture 39 !• 02 


1 


391.02 


3.17 


’within 


5l'35.11 


■ 44 


123.53 


1 

y 



■>'*■'• Sls:nif leant at the .01 level. 



Conclus ions 

The experiment indich-tes the imoortance of lecture oartici- 

-# 

pation in promoting student achievement. Dialo?r.ue between teacher 
and student appears to support student development of certain 
intellectual shills and abilities unobtainable by readiny of the 
text alone. Thouyh an item anal.^/sis of the post- test was not 
performed, the outside observer grading the tests noted that subjects 
the lecture (whether usinr the text or not) seemed to 



^ 4» /Q a ’/>' 

O J. 



"Interpretation, 



U tl--. 



.-Vi 



and orga.nl national principles and Synthesis . 



ual abilities 


as 


of elements. 


rela 
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A factorial experlrn.;rit xas carried out to detarriine tae e^^eco 
•of text ak lecture or. student acbieveinent in a ireshP-n psycnolor/ 
course. Fcrty-ei?;?).! sub:iocts xere randoraly assigned to four treat- 
ajsnt <i;roup3 differinp .as to i.'hefner they receivea rext or lecture or 
both. A rre-test v:es .-riven and after the treatn>ents, one idenoical 
o-/-;: rr’T -r.a t io^ Y^- s y'ven as the ">ost~' test . The post-test score^-j vere 
subisctsd to an anslysls of variance, vhioh indicated that receiving 
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A 31oo.T!*s Ta>:cr.O!ny Of Co.7r.itlve Behaviors 
3 Introductcr.7 Povchclogy Zxarniratlcn 
C Test Questions Coded for Cognitive Behaviors 

D Frequency Distribution for Pre-test Scores 

* 

S Frequency Distributicn for Post- test Scores 







APPENDIX A 



Taxonomy of Educational Objectives 



Cognitive Domain 



KNOWLEDGE 



1.00 KNOWLEDGE 

Knowledge, as defined here. Involves the recall of specifics and unlversals, 
the recall of methods and processes, or the recall of a pattern, structure, 
or setting. For measurement purposes, the recall situation Involves little 
more than bringing to mind the appropriate materials. Although some alteration 
of the material may be required, this Is a relatively minor part of the task. 
The knowledge objectives emfdiaslze siost the psychological processes of re- 
membering. The process of relating Is also Involved In that a knowledge test 
situation requires the organization and reorganization of a problem such that 
It will furnish the appropriate signals and cues for the Information and 
knowledge the Individual possesses. To use an analogy. If one thlidcs of the 
mind as a file, the problem In a knowledge test situation Is that of finding 
In the problem or task the appropriate signals, cues, and clues which will 
most effectively bring out whatever knowledge Is filed or stored. 

1.10 KNOWLEDGE OF SPECIFICS 



The recall of specific and Isolable bits of Information. The emphasis 
Is on symbols with concrete referents. This material,, which Is at a 
very low level of abstraction, may be thought of as the elements from 
which sK>re complex and abstract forms of knowledge are built. 

1.11 KNOWLEDGE OF TERMINOLOGY 

Knowledge of the referants for specific symbols (verbal and non- 
verbal). This smy Include knowledge of the sK>st generally accepted 
symbol referent, knowledge of the variety of symbols which may be 
used for a single referent, or knowledge of the referent most 
appropriate to a given use of a symbol. 

*To define technical terms by giving their 
attributes, properties, or relations. 

^Familiarity with a large number of words 
in their comiion range of meanings. 




1.12 KHOWLEDGE OF SPECIFIC FACTS 



Knowledge of dates, events, persons, places, etc. This may include 
vefy precise and specific information such as the specific date or 
exact magnitude of a phenomenon. It may also include approximate 
or relative information such as an approximate time period or the 
general order of magnitude of a phenomenon. 

♦The recall of major facts about particular cultures. 

♦The possession of a minimum of knowledge about the 

organisms studied in the laboratory. 

1.20 KNOWLEDGE OF WATS AND MEANS OF DEAUIC WITH SPECIFICS 

Knowledge of the ways of organizing, studying, judging, and 
criticizing. This includes the methods of inquiry, the chro- 
nological sequences, and the standards of judgment within a 
field as well as the patterns of organization through which the 
areas of the fields themselves are determined and internally 
organized. This knowledge is at an intermediate levels of abstraction 
between specific knowledge on the one hand and knowledge of 
univerosls on the other. It does not so much demand the activity 
of the student in using the materials as it does a more passive 
awareness of their nature. 

1.21 KNOWLEDGE OF CONVENTIONS 

Knowledge of characteristic ways of treating and presenting ideas 
and phenomena. For purposes of communication and consistency, 
workers in a field employ usages, styles, practices, and forms 
which best suit their purposes and/or which appear to suit best 
the phenomena with which they deal. It should be recognized that 
although these forms and conventions are likely to be set up on 
arbitrary, accidental, or authoritative bases, they are retained 
because of the general agreement or concurrence of individuals 
concerned with the subject, phenomena, or problem. 

♦Familiarity with the forms and conventions of the major 
types of works, e. g«, scientific papers, etc. 

♦To make pupils conscious of correct form and usage in speech 
and writing. 

1.22 KMOWLEDGE OF TRENDS AND SEQUENCES 

giiQif ledge of the processes, directions, and movements of phenomena 
with respect to time. 

♦Understanding of the continuity and development of American 
culture as exemplified in American life. 



1.23 KMOtfLEDCE OF CLASSIFICATION AND CATEGORIES 



Knowledge of the classes, sets, divisions, and arrangements 
idiich are regarded as fundamental for a given subject field, 
purpose, argument, or problem. 

*To recognize the area encompasses by various kinds of 
problems or materials. 

*Becoming familiar with the range of types of literature. 

1.24 KNOWLEDGE OP CRITERIA 

Knowledge of the criteria by which facts, principles, opinions, 
and conduct are tested or judged. 

*Familiarity with criteria for judgment appropriate to 
the type of work and the purpose for which it is read. 

1.25 KNOWLEDGE OF METHODOLOGY 

Knowledge of the methods of inquiry, techniques, and procedures 
esq>loyed in a particular subject field as well as those employed 
in investigating particular problems and phenomena. The emphasis 
here is on the individual's knowledge of the method rather than 
his ability to use the method. 

*Knowledge of scientific methods for evaluating psychological 
concepts. 

i*The student shall know the methods of attack relevant 
to the kinds of problems of concern, to the behavioral 
sciences. 

1.30 KNOWLEDGE OP THE UNIVERSALS AND ABSTRACTIONS IN A FIELD 

Knowledge of the major schemes and patterns by which phenomena 
and ideas are organized. These are the large structures, theories, 
and generalizations which dominate a subject field or which are 
quite generally used in studying phenomena or solving problems. 
These are at the highest levels of abstraction and complexity. 

1.31 KMOWLEDCE OF PRINCIPLES AND GENERAUZATIONS 

Knowledge of particular abstractions which summarize 
observations of phenomena. These are the abstractions 
which are of value in explaining, describing, predecting, 
or in determining the most appropriate and relevant action 
or direction to be taken. 

^Knowledge of the important principles by which our 
experience with psychological phenomena is summarized. 




*The recall of major generalizations about 
particular cultures and its impact of the 
development of personality. 

1.32 KNOWLEDGE OP THEORIES AND STROCTURES 

Knowledge of the body of principles and generalizations 
together with their interrelations which present a clear, 
rounded, and systematic view of a complex phenomenen, 
problem, or field. These are the most abstract form- 
ulations, and they can be used to show the interrelation 
and organization of a great range of specifics. 

*The recall of major theories about particular cultures. 

^Knowledge of a relatively complete formulation of the 
theory of evelution with regards to psychosocial 
factors of human survival. 

INTELLECTUAL ABILITIES AND SKILLS 

Abilities and skills refer to organized modes or operation and generalized 
techniques for dealing with siaterials and problems. The materials and 
problems may be of such a nature that little or no specialized and 
technical information is required. Such information as is required can 
be assumed to be part of the individual's general fund of knowledge. 

Other problems may require specialized and technical information at a 
rather high level such that specific knowledge and skill in dealing 
with the problem and the materials are required. The abilities and 
skills objectives emphasize the mental processes of organizing and re- 
organizing material to achieve a particular purpose. The siaterials 
may be given or remembered. 

2.00 COMPREHENSION 



This represents the lowest level of understanding. It refers to 
a type of understanding or apprehension such that the individual 
knows what is being communicated and can make use of the material 
or idea being communicated without necessarily relating it to 
other material or seeing its cullest implications. 

2.10 TRANSLATION 



Comprehension as evidenced by the car and accuracy with which 
the communication is paraphrased or rendered from one language 
or form of communication to another. Translation is judged on 
the basis of faithfulness and accuracy, that is, on the extent 
to which the material in the original communication is preserved 
although the form in the communication has been altered. 

*Skill in translating mathematical verbal material into 
symbolic statements and vice versa. 



2.20 



INTERPRETATION 



The explanation or susamarlzatlon of a cooinunlcatlon. Whereas 
translation Involves an objective part- for- part rendering of 
a communication, interpretation involves a rendering, rearrangement, 
or a new view of the material. 

*The ability to grasp the thought of the work as a whole 
at any desired level of generality. 

*The ability to interpret various types of social data. 

2.30 EXTRAPOLATION 

The extension of trends or tendencies beyond the given data to 
determine implications, consequences, corollaries, effects, etc., 
which are in accordance with the conditions described in the 
original communication. 

*The ability to deal with the conclusions of a work In 
terms of the Immediate inference made from the explicit 
statements. 

*Skill in predicting continuation of trends. 

3.00 APPLICATION 



The use of abstratlons in particular and concrete situation. The 
abstractions may be in the form of general ideas, rules of procedures, 
or generalized methods. The abstractions may also be technical 
principles, ideas and theories which must be remembered and 
applied. 



*Appllcatlons to the phenomena discussed in one paper of 
the scientific tetms or concepts used In other papers. 

*The ability to predict the probable effect of a change in 
a factor on a psychological situation previously at 
equilibrium. 



4.00 ANALYSIS 



The breakdown of a communication into its constituent elements or 
parts such that the relative hierarchy of ideas is made clear 
and/or the relations between the ideas expressed are made explicit. 
Such analyses are Intended to clarify the communication, to indicate 
how the communication is organized, and the way in which it manages 
to convey its effects, as well as its basis and arrangement. 




4.10 



ANALYSIS OF ELEMENTS 



Identification of the elements included in a 
communication • 

*The ability to recognize unstated assumptions. 

*Skill in distinguishing facts from hypotheses. 

4.20 ANALYSES OF RELATIONSHIPS 

The connections and interactions between elements and parts 
of a communication. 

^Ability to check the consistency of hypotheses with 
given information and assumptions. 

4.30 ANALYSIS OF ORGANIZATIONAL PRINCIPLES 

The organization, systematic arrangement, and structure 
which holds the communication together. This includes 
the "explicit" as well as "implicit" structure. It 
includes the bases, necessary arrangement, and the 
mechanics which make the communication a unit. 

^Ability to recognize the general techniques used in 
persuasive materials, such as advertising, propaganda, 
etc. 



5.00 SYNTHESIS 



The putting together of elements and parts so as to form a whole. 

This involves the process of working with pieces, parts, elements, 
etc., and arranging and combining them in such a way as to constitute 
a pattern or structure not clearly there before. 

5.10 PRODUCTION OF A UNIQUE CCTIMONICATION 

The development of a communication in which the writer or 
speaker attempts to convey ideas, feelings, and/or 
experiences to others. 

♦Skill in writing, using an excellent organisation of 
ideas and statements. 

5.20 PRODUCTION OF A PLAN. OR PROPOSED SET OF OPERATIONS 

The development of a plan of work or the proposal of a plan 
of operations. The plan should satisfy requirements of the 
task which may be given to the student or which he may 
develop for himself. 

♦Ability to propose way of testing hypotheses. 




5.30 DERIVATION OF A SET OF ABSTRACT RELATIONS 

The development of a set of abstract relations either to classify 
or explain particular data or phenomena, or the deduction of pro- 
positions and relations from a set of basic propositions or symbolic 
representations • 

^Ability to formulate appropriate hypotheses based upon an 
analysis of factors involved, and to modify such hypotheses 
in the light of new factors and considerations. 

6.00 EVALUATION 



Judgments about the value of material and methods for given pur- 
poses. Quantitative and qualitative judgments about the extent 
to which material and methods satisfy criteria. Use of a standard 
of appraisal. The criteria may be those detennlned by the student 
or those which are given to him. 

6.10 JUDGMENTS IN TERMS OF INTERNAL EVIDENCE 

Evaluation of the accuracy of a communication from such 
evidence as logical accuracy, consistency, and other 
internal criteria. 

*Judging by internal standards, the ability to assess 
general probability of accuracy in reporting facts 
from the care given to exactness of statement, docu- 
mentation, prof, etc. 

*The ability to Indicate logical fallacies In arguments. 

6.20 JUDGMENTS IN TERMS OF EXTERNAL CRITERIA 



Evaluation of material with reference to selected or remembered 
criteria. 

*The comparison of major theories, generalizations, and 
facts about particular cultures. 

*Judglng by external standards, the ability to compare 
a work with the highest known standards in Its fleld-- 
especially with other workds of recognized excellence. 
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T'fi-o de.f ir.tio'n of the terni "personality'' is a Iona one 
of th.e defintlon of perso):--=lity refers to 



f.h p. 



C>. 4) 

b. 
c • 
d. 



characteristic and distinctive 
strength of character, 
depth of the unconscious. 



traits of an individual. 



sj IS. V w i W ^ • 

nomothetic traits which inane a person act differently 
froiD time to time in the same situation. 



Any asoect of pcrsono.lity that is reasonably characteristic 
and distinctive is usually called a 



a. 

b. 

c. 

d. 



mod; 



factor. 



tr 



^ JL Lp ( 



type 



the study of per- 



One use to which fcictor analysis has been put in 
sonality is to 

a. draw conclusions about the change in a particular trait 
over the lifetime of an indj.vidual. 
shovj the continuous distribution of a particular 
quail t.y in the total population, 
reduce to a smaller number the number of traits 
reauired to describe an individual ade'ouately. 



D. 

c. 

d. 



determine the 
always use in 



correct numoer oi 
cccnjaring peonle 



f traits we should 



!!nf avoidance , 
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c^i^(3v.^n ■f'romi controlled home atmospheres tend to be more 
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forming than children from democratic home atmospheres. 

The development of the responses, interests, ana oensvior» approp-ia. 
to one's sex is called 
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